{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Identifying country names from incomplete house addresses"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h1>Table of Contents<span class=\"tocSkip\"></span></h1>\n",
    "<div class=\"toc\">\n",
    "<ul class=\"toc-item\">\n",
    "<li><span><a href=\"#Introduction\" data-toc-modified-id=\"Introduction-1\">Introduction</a></span></li>\n",
    "<li><span><a href=\"#Prerequisites\" data-toc-modified-id=\"Prerequisites-2\">Prerequisites</a></span></li>\n",
    "<li><span><a href=\"#Imports\" data-toc-modified-id=\"Imports-3\">Imports</a></span></li>\n",
    "<li><span><a href=\"#Data-preparation\" data-toc-modified-id=\"Data-preparation-4\">Data preparation</a></span></li>\n",
    "<li><span><a href=\"#TextClassifier-model\" data-toc-modified-id=\"TextClassifier-model-5\">TextClassifier model</a></span></li>\n",
    "<ul class=\"toc-item\">\n",
    "<li><span><a href=\"#Load-model-architecture\" data-toc-modified-id=\"Load-model-architecture-5.1\">Load model architecture</a></span></li>\n",
    "<li><span><a href=\"#Model-training\" data-toc-modified-id=\"Model-training-5.2\">Model training</a></span></li>    \n",
    "<li><span><a href=\"#Validate-results\" data-toc-modified-id=\"Validate-results-5.3\">Validate results</a></span></li>\n",
    "<li><span><a href=\"#Model-metrics\" data-toc-modified-id=\"Model-metrics-5.4\">Model metrics</a></span></li>    \n",
    "<li><span><a href=\"#Get-misclassified-records\" data-toc-modified-id=\"Get-misclassified-records-5.5\">Get misclassified records</a></span></li>\n",
    "<li><span><a href=\"#Saving-the-trained-model\" data-toc-modified-id=\"Saving-the-trained-model-5.6\">Saving the trained model</a></span></li>\n",
    "</ul>\n",
    "<li><span><a href=\"#Model-inference\" data-toc-modified-id=\"Model-inference-6\">Model inference</a></span></li>\n",
    "<li><span><a href=\"#Conclusion\" data-toc-modified-id=\"Conclusion-7\">Conclusion</a></span></li>\n",
    "<li><span><a href=\"#References\" data-toc-modified-id=\"References-8\">References</a></span></li>\n",
    "</ul></div>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Introduction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[Geocoding](https://en.wikipedia.org/wiki/Geocoding) is the process of taking input text, such as an **address** or the name of a place, and returning a **latitude/longitude** location for that place. In this notebook, we will be picking up a dataset consisting of incomplete house addresses from 10 countries. We will build a classifier using `TextClassifier` class of `arcgis.learn.text` module to predict the country for these incomplete house addresses. \n",
    "\n",
    "The house addresses in the dataset consist of text in multiple languages like English, Japanese, French, Spanish, etc. The dataset is a small subset of the house addresses taken from [OpenAddresses data](http://results.openaddresses.io/) \n",
    "\n",
    "**A note on the dataset**\n",
    "- The data is collected around 2020-05-27 by [OpenAddresses](http://openaddresses.io).\n",
    "- The data licenses can be found in `data/country-classifier/LICENSE.txt`."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Prerequisites"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Data preparation and model training workflows using arcgis.learn have a dependency on [transformers](https://huggingface.co/transformers/v3.0.2/index.html). Refer to the section **\"Install deep learning dependencies of arcgis.learn module\"** [on this page](https://developers.arcgis.com/python/guide/install-and-set-up/#Install-deep-learning-dependencies) for detailed documentation on the installation of the dependencies.\n",
    "\n",
    "- **Labeled data**: For `TextClassifier` to learn, it needs to see documents/texts that have been assigned a label. Labeled data for this sample notebook is located at `data/country-classifier/house-addresses.csv`\n",
    "\n",
    "- To learn more about how `TextClassifier` works, please see the guide on [Text Classification with arcgis.learn](https://developers.arcgis.com/python/guide/text-classification)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Imports"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os\n",
    "import zipfile\n",
    "import pandas as pd\n",
    "from pathlib import Path\n",
    "from arcgis.gis import GIS\n",
    "from arcgis.learn import prepare_textdata\n",
    "from arcgis.learn.text import TextClassifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "gis = GIS('home')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Data preparation\n",
    "\n",
    "Data preparation involves splitting the data into training and validation sets, creating the necessary data structures for loading data into the model and so on. The `prepare_data()` function can directly read the training samples and automate the entire process."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div class=\"item_container\" style=\"height: auto; overflow: hidden; border: 1px solid #cfcfcf; border-radius: 2px; background: #f6fafa; line-height: 1.21429em; padding: 10px;\">\n",
       "                    <div class=\"item_left\" style=\"width: 210px; float: left;\">\n",
       "                       <a href='https://geosaurus.maps.arcgis.com/home/item.html?id=ab36969cfe814c89ba3b659cf734492a' target='_blank'>\n",
       "                        <img src='' width='200' height='133' class=\"itemThumbnail\">\n",
       "                       </a>\n",
       "                    </div>\n",
       "\n",
       "                    <div class=\"item_right\"     style=\"float: none; width: auto; overflow: hidden;\">\n",
       "                        <a href='https://geosaurus.maps.arcgis.com/home/item.html?id=ab36969cfe814c89ba3b659cf734492a' target='_blank'><b>country_classifier</b>\n",
       "                        </a>\n",
       "                        <br/>Training data for TextClassifier class of arcgis.learn.text module<img src='https://geosaurus.maps.arcgis.com/home/js/jsapi/esri/css/images/item_type_icons/layers16.png' style=\"vertical-align:middle;\">Image Collection by api_data_owner\n",
       "                        <br/>Last Modified: December 01, 2020\n",
       "                        <br/>0 comments, 0 views\n",
       "                    </div>\n",
       "                </div>\n",
       "                "
      ],
      "text/plain": [
       "<Item title:\"country_classifier\" type:Image Collection owner:api_data_owner>"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "training_data = gis.content.get('ab36969cfe814c89ba3b659cf734492a')\n",
    "training_data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "filepath = training_data.download(file_name=training_data.name)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "with zipfile.ZipFile(filepath, 'r') as zip_ref:\n",
    "    zip_ref.extractall(Path(filepath).parent)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "DATA_ROOT = Path(os.path.join(os.path.splitext(filepath)[0]))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "data = prepare_textdata(DATA_ROOT, \"classification\", train_file=\"house-addresses.csv\", \n",
    "                        text_columns=\"Address\", label_columns=\"Country\", batch_size=64)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The `show_batch()` method can be used to see the training samples, along with labels."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070 th {\n",
       "          text-align: left;\n",
       "    }#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row0_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row0_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row1_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row1_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row2_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row2_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row3_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row3_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row4_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row4_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row5_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row5_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row6_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row6_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row7_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row7_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row8_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row8_col1,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row9_col0,#T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row9_col1{\n",
       "            text-align:  left;\n",
       "        }</style><table id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070\" ><thead>    <tr>        <th class=\"col_heading level0 col0\" >Address</th>        <th class=\"col_heading level0 col1\" >Country</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row0_col0\" class=\"data row0 col0\" >S/N, LG CASARES, 32170</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row0_col1\" class=\"data row0 col1\" >ES</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row1_col0\" class=\"data row1 col0\" >SN, CALLE E. NABARRETE, PLAN DE AYALA (CAMPO CINCO), Ahome, Sinaloa</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row1_col1\" class=\"data row1 col1\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row2_col0\" class=\"data row2 col0\" >152, RUA SANTA RITA DURAO, Belo Horizonte, MG, 30140-110</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row2_col1\" class=\"data row2 col1\" >BR</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row3_col0\" class=\"data row3 col0\" >133, Warande, 201, 9660</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row3_col1\" class=\"data row3 col1\" >BE</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row4_col0\" class=\"data row4 col0\" >4000, 13 Avenue SE, 133, MEDICINE HAT</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row4_col1\" class=\"data row4 col1\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row5_col0\" class=\"data row5 col0\" >12, Avenue de la République, Beauvais, 60000</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row5_col1\" class=\"data row5 col1\" >FR</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row6_col0\" class=\"data row6 col0\" >1487-6, 有馬町</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row6_col1\" class=\"data row6 col1\" >JP</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row7_col0\" class=\"data row7 col0\" >4, Rue d'Houat, Saint-Gilles, 35590</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row7_col1\" class=\"data row7 col1\" >FR</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row8_col0\" class=\"data row8 col0\" >32, Hartjie My Liefie Avenue, Bloemfontein, Mangaung</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row8_col1\" class=\"data row8 col1\" >ZA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row9_col0\" class=\"data row9 col0\" >Street, Centurion, City of Tshwane</td>\n",
       "                        <td id=\"T_12dd9eba_33a6_11eb_8fb5_a4bb6dafa070row9_col1\" class=\"data row9 col1\" >ZA</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x20eb7a87cc8>"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data.show_batch(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# TextClassifier model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`TextClassifier` model in `arcgis.learn.text` is built on top of [Hugging Face Transformers](https://huggingface.co/transformers/v3.0.2/index.html) library. The model training and inferencing workflow are similar to computer vision models in `arcgis.learn`. \n",
    "\n",
    "Run the command below to see what backbones are supported for the text classification task."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['BERT', 'RoBERTa', 'DistilBERT', 'ALBERT', 'FlauBERT', 'CamemBERT', 'XLNet', 'XLM', 'XLM-RoBERTa', 'Bart', 'ELECTRA', 'Longformer', 'MobileBERT']\n"
     ]
    }
   ],
   "source": [
    "print(TextClassifier.supported_backbones)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Call the model's `available_backbone_models()` method with the backbone name to get the available models for that backbone. The call to **available_backbone_models** method will list out only few of the available models for each backbone. Visit [this](https://huggingface.co/transformers/pretrained_models.html) link to get a complete list of models for each backbone."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "('xlm-roberta-base', 'xlm-roberta-large')\n"
     ]
    }
   ],
   "source": [
    "print(TextClassifier.available_backbone_models(\"xlm-roberta\"))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Load model architecture"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Invoke the `TextClassifier` class by passing the data and the backbone you have chosen. The dataset consists of house addresses in multiple languages like Japanese, English, French, Spanish, etc., hence we will use a [multi-lingual transformer backbone](https://huggingface.co/transformers/v3.0.2/multilingual.html) to train our model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model = TextClassifier(data, backbone=\"xlm-roberta-base\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Model training"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The `learning rate`[[1]](#References) is a **tuning parameter** that determines the step size at each iteration while moving toward a minimum of a loss function, it represents the speed at which a machine learning model **\"learns\"**. `arcgis.learn` includes a learning rate finder, and is accessible through the model's `lr_find()` method, that can automatically select an **optimum learning rate**, without requiring repeated experiments."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYoAAAEGCAYAAAB7DNKzAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nO3deXzkZZXv8c/JvifdSXpf0k03NAh0t92grCpu4CiiwCwq48LAdZxRXGbGOzrjuMwicgGHWQQuqOjgoAN4BRlUdJAGkcbuphd6odf0vmRfqpJUJXXuH1VpQqhUkk5+qYXv+/WqV6p+9dSvzpNK6tTzPL/fKXN3RERERpKX7gBERCSzKVGIiEhKShQiIpKSEoWIiKSkRCEiIikVpDuA8aqrq/OGhoZ0hyEiklXWr1/f7O71p/LYrEsUDQ0NrFu3Lt1hiIhkFTPbf6qP1dSTiIikpEQhIiIpKVGIiEhKShQiIpKSEoWIiKSkRCEiIikpUYiISEpKFCIiWeCbv9zJM7ua0/LcShQiIhkuHOnnn3+1i/X729Ly/EoUIiIZbsexLtzhrDlVaXl+JQoRkQy37UgnoEQhIiIj2Ha0k+rSQuZUl6Tl+ZUoREQy3NYjnZw1uwozS8vzK1GIiGSw/oEYO452pm3aCZQoREQyWmNLiL7+GGfNVqIQEZEktqZ5IRuUKEREMtq2o50U5eexZEZF2mJQohARyWDbjnRy+qwKCvPT93atRCEikqHcnW2JI57SKbBEYWYlZva8mW0ys61m9pUkbT5rZtvMbLOZ/crMFgYVj4hItmnq6qMlFMndRAH0AZe5+3JgBXC5mb1xWJsXgNXufi7wIPCNAOMREckqW48OLmRXpzWOwBKFx3UnbhYmLj6szZPuHk7cfA6YF1Q8IiLZZrB0x7LZlWmNI9A1CjPLN7ONwAngCXdfm6L59cDjI+znRjNbZ2brmpqagghVRCTjbDvSyYLpZVSVFKY1jkAThbsPuPsK4iOF883s7GTtzOxDwGrglhH2c7e7r3b31fX19cEFLCKSQbYdTf9CNkzRUU/u3g48CVw+/D4zexvwReBKd++binhERDJdd18/jS2htJ5oNyjIo57qzawmcb0UeDuwY1iblcBdxJPEiaBiERHJNi8d64x/B0UGjCgKAtz3bOA+M8snnpB+5O4/NbOvAuvc/RHiU00VwH8lqiIecPcrA4xJRCQrDC5kv25uDicKd98MrEyy/UtDrr8tqOcXEclm2452Mq2skFlV6fkOiqF0ZraISAbadiReWjxd30ExlBKFiEiG6R+IseNYV0asT4AShYhIxtnbnPgOigw44gmUKEREMs7gQvZZs9NbumOQEoWISIY50BqvbNRQV5bmSOKUKEREMkxrKEJlSQHFBfnpDgVQohARyTgtoQi15UXpDuMkJQoRkQzT0t1HbUVxusM4SYlCRCTDtIYiTNeIQkRERqKpJxERGVEs5rSGItRWKFGIiEgSnb1RBmLO9HKtUYiISBItoQiApp5ERCS5lu5EotDUk4iIJNMain/Rp456EhGRpJoHRxRaoxARkWRaE2sUGlGIiEhSg3Weigoy5+05cyIRERGau/sy6ognUKIQEcko8ZPtMmd9ApQoREQySqbVeQIlChGRjNLcHaEug86hACUKEZGMEYs5bWGNKEREZASZWOcJlChERDLG4Ml2mnoSEZGkMvFkO1CiEBHJGJlY5wmUKEREMsbLU09aoxARkSQGp56mlWlEISIiSWRinScIMFGYWYmZPW9mm8xsq5l9JUmbYjP7oZntNrO1ZtYQVDwiIpmuubsv46adINgRRR9wmbsvB1YAl5vZG4e1uR5oc/clwO3AzQHGIyKS0TKxfAcEmCg8rjtxszBx8WHN3gvcl7j+IPBWM7OgYhIRyWSvuUQBYGb5ZrYROAE84e5rhzWZCxwEcPd+oAOoTbKfG81snZmta2pqCjJkEZG0ycQ6TxBwonD3AXdfAcwDzjezs09xP3e7+2p3X11fXz+5QYqIZIBMrfMEU3TUk7u3A08Clw+76zAwH8DMCoBqoGUqYhIRySSZWucJgj3qqd7MahLXS4G3AzuGNXsE+HDi+jXA/7j78HUMEZGcl6l1ngAKAtz3bOA+M8snnpB+5O4/NbOvAuvc/RHgXuD7ZrYbaAX+MMB4REQyVqbWeYIAE4W7bwZWJtn+pSHXe4Frg4pBRCRbZGqdJ9CZ2SIiGSFT6zyBEoWISEbI1DpPoEQhIpIRWkMRqjKwzhMoUYiIZITm7j5qM3DaCZQoREQyQqaW7wAlChGRjNAailCrRCEiIiNp7o5Qm4En24EShYhI2mVynSdQohARSbvBOk+1GVjnCZQoRETSbvBkO009iYhIUplc5wmUKERE0q6lO17nSVNPIiKSVEtIU08iIpJCJtd5AiUKEZG0a+nuy9g6T6BEISKSdi2hSMbWeQIlChGRtMvkOk+gRCEiknYt3Zlb5wmUKERE0srdOdHVm7FHPIEShYhIWu060U1bOMryeTXpDmVEShQiImm0ZmcTAJeeXp/mSEamRCEikkZP7WxiyYwK5tSUpjuUESlRiIikSW90gOf3tXLp0swdTYAShYhI2qzd10pff4w3naFEISIiSazZ2URxQR5vWDQ93aGkpEQhIpImT+1s4vxF0ykpzE93KCkpUYiIpMGR9h52n+jmTRl8tNMgJQoRkTTIhsNiBylRiIikwZpdTcyqKmHpjIp0hzIqJQoRkSnWPxDjmV3NXHp6HWaW7nBGFViiMLP5ZvakmW0zs61mdlOSNtVm9qiZbUq0+WhQ8YiIZIpNhzro7O3PimkngIIA990PfM7dN5hZJbDezJ5w921D2vwZsM3d32Nm9cBLZna/u0cCjEtEJK3W7Gwiz+DiJXXpDmVMxjSiMLNyM8tLXD/dzK40s8JUj3H3o+6+IXG9C9gOzB3eDKi0+NirAmglnmBERHLWml1NnDuvhpoM/erT4cY69bQGKDGzucCvgI8C3x3rk5hZA7ASWDvsrn8FzgSOAFuAm9w9Ntb9iohkm/ZwhE0H27Nm2gnGnijM3cPA+4F/cff3Aa8b0wPNKoCHgE+7e+ewu98JbATmACuAfzWzqiT7uNHM1pnZuqampjGGLCKSeX67p4WYw5tOz45pJxhHojCzC4APAo8lto16KmFieuoh4H53fzhJk48CD3vcbmAfsGx4I3e/291Xu/vq+vrsycIiIsMdausBYOnMyjRHMnZjTRSfBv4a+LG7bzWzxcCTqR6QWHe4F9ju7reN0OwA8NZE+5nAGcDeMcYkIpJ12nsi5OcZlcVBHks0ucYUqbs/BTwFkFjUbnb3T43ysIuA64AtZrYxse0LwILEPu8EvgZ818y2AAZ83t2bx90LEZEs0R6OUlNamBXnTwwaU6Iwsx8AHwcGgPVAtZnd5u63jPQYd3+G+Jv/iNz9CPCOsYcrIpLd2sNRqstSHjSaccY69XRWYiH6KuC/iY8KrgssKhGRHNXeE2FalhwWO2isiaIwsTB9FfATd48SPwdCRETGYXDqKZuMNVHcBTQC5cAaM1sIDD/UVURERpGNU09jXcy+A7hjyKb9ZvaWYEISEcld7eEcnXpKFO+7bfCkNzO7lfjoQkRExijSHyMUGcjZqadvA13A7ycuncB3ggpKRCQXtffE653W5OLUE3Cau1895PZXhpwbISIiY9ARjgJQnYtTT0CPmV08eMPMLgJ6gglJRCQ3tffEE8W0HB1RfBz4nplVJ263AR8OJiQRkdzUFkpMPZVm14hirEc9bQKWD1Z2dfdOM/s0sDnI4EREcsngiCLb1ijG9VWo7t45pFT4ZwOIR0QkZw2uUeR0ohgmeypaiYhkgLZwvHJsRRZVjoWJJQqV8BARGYf2nuyrHAujrFGYWRfJE4IBpYFEJCKSozrC0aybdoJREoW7Z89XMImIZLj2ngg1WXYOBUxs6klERMahLZR9lWNBiUJEZMp09EQ1ohARkZG1hyNZuUahRCEiMgWytXIsKFGIiEyJk5VjyzX1JCIiSZw8K1sjChERSaYtS8t3gBKFiMiUaA/Hp56y7WtQQYlCRGRKDFaOrdbUk4iIJDM4otDUk4iIJNUejlKQhZVjQYlCRGRKtPfECwJmW+VYUKIQEZkSHeFoVq5PgBKFiMiUaAtnZ+VYUKIQEZkS7eEo07JwIRuUKEREpkRHT5TqUo0oXsHM5pvZk2a2zcy2mtlNI7R7s5ltTLR5Kqh4RETSqS1LK8fCKN9wN0H9wOfcfYOZVQLrzewJd9822MDMaoB/By539wNmNiPAeERE0qKvf4BwZEBTT8O5+1F335C43gVsB+YOa/YB4GF3P5BodyKoeERE0qVj8KxsLWaPzMwagJXA2mF3nQ5MM7Nfm9l6M/vjER5/o5mtM7N1TU1NwQYrIjLJ2rO4cixMQaIwswrgIeDT7t457O4CYBXwe8A7gb81s9OH78Pd73b31e6+ur6+PuiQRUQm1WCiyMaCgBDsGgVmVkg8Sdzv7g8naXIIaHH3EBAyszXAcmBnkHGJiEylbK7zBMEe9WTAvcB2d79thGY/AS42swIzKwPeQHwtQ0QkZwyOKLL1zOwgRxQXAdcBW8xsY2LbF4AFAO5+p7tvN7OfAZuBGHCPu78YYEwiIlNu8GtQp2Xh16BCgInC3Z8BRq1+5e63ALcEFYeISLoNVo4tL8pPdyinRGdmi4gELJsrx4IShYhI4NqzuCAgKFGIiASuPRzN2nMoQIlCRCRw7eFo1h4aC0oUIiKB09STiIik1N6jqScRERnBYOVYTT2JiEhSHeHsrhwLShQiIoFq7xksCKgRhYiIJPFyiXGNKEREJIm2LK8cC0oUIiKBGlyjUKIQEZGkBivH6jwKERFJKtsrx4IShYjIpOkfiPHs7mYGYn5yW1s4Sk1ZUdZWjgUlChGRSfPTzUf5wD1rufbOZ9nb1A1AR08kq9cnQIlCRGTS7DzeRX6esacpxLvueJrv/GYfraFIVpfvACUKEZFJ09gSYsH0Mn7xmUu5YHEtX3l0G8/tbc3qhWxQohARmTT7msM01JYxs6qEb3/kPL5x9blUFBdw2ozydIc2IYF9Z7aIyGuJu7O/JcQbF08HwMz4/fPmc+WKOeTnZe9CNihRiIhMihNdfYQjAyyqe+XooaQwew+LHaSpJxGRSbCvOQRAQ212TzMlo0QhIjIJGhOJYviIIhcoUYiITIJ9LSGK8vOYU1Oa7lAmnRKFiMgkaGwOMX96adYvXCejRCEiMgkam8M5Oe0EShQiIhMWizmNLaGcXMgGJQoRkQk71tlLX3+MBo0oREQkmVw+4gmUKEREJmxfS+IcCiWK8TGz+Wb2pJltM7OtZnZTirbnmVm/mV0TVDwiIkFpbA5RXJDH7KqSdIcSiCBLePQDn3P3DWZWCaw3syfcfdvQRmaWD9wM/CLAWEREArOvOczC2jLycvDQWAhwROHuR919Q+J6F7AdmJuk6SeBh4ATQcUiIhKkXD7iCaZojcLMGoCVwNph2+cC7wO+NRVxiIhMtoGYc6Ald8+hgClIFGZWQXzE8Gl37xx29zeBz7t7bJR93Ghm68xsXVNTU1ChioiM25H2HiIDuXtoLARcZtzMCoknifvd/eEkTVYDDyS+dLwOeJeZ9bv7/xvayN3vBu4GWL16tb9qLyIiadLYkrtVYwcFligs/u5/L7Dd3W9L1sbdFw1p/13gp8OThIhIJsv1cygg2BHFRcB1wBYz25jY9gVgAYC73xngc4uITIl9zWFKC/OZWVWc7lACE1iicPdngDEfK+buHwkqlrFo7u7j/ucOsOFAG1etnMO7z51DYb7ORxSR1BpbQiysLSMxhZ6TXjNfhdrc3cfuE93UVxZTX1lMZXEBZsZLx7r49jP7+PHGw0T6Y8yqKuEzP9zELT97iY9dvIg/PH8BFcWvmV+TiIxTY3OIM2ZVpjuMQL1m3gGf29vCn//ghZO3iwvymF5exNGOXkoK87h21Tw+etEiFteV8+udJ7jrqb38/WPbueNXu7j+4sXccOkiyopeM78uERmD/oEYB1rDvPPsWekOJVCvmXe+C0+r4wd/8gaauvto6urjRFf859KZFfzReQuYVl50su1ly2Zy2bKZvHCgjW/9eg+3/3In96/dz2fffjrXrp6fk19MIiLjd7i9h/6YsyiHj3iC11CimF5exIVL6sb1mJULpnH3H69m/f5W/uGx7fzvh7fw7d/s4/OXL+OyZTNyek5SXuP27IFbb4X/+A/o7oaKCvjQh+Bzn4PTTkt3dBljX3NuFwMcpNXaMVi1cDoP/emFfOuDryfSH+P6+9bxjtvX8IO1B+iJDKQ7PJHJ9fjjcO65cM890NUF7vGf99wT3/744+mOMGM0nkwUZWmOJFhKFGNkZlxxzmx+8Zk3ceu1yykqyOMLP97CBV//FTf/bAdH2nvSHaLIxO3ZA9dcA+EwRKOvvC8ajW+/5pp4O6GxJUx5UT71Fbl7aCwoUYxbUUEeV6+ax08/eTE/+l8X8MZFtdz11B4u+caTfPz763l2TzPuqU8ej8Wc3+5p4cH1h2gLRaYocpExuPXWVyeI4aJRuP32qYkng8Vizo5jnTTUlef8NLSN9qaWaVavXu3r1q1LdxivcLA1zP1rD/DA7w7QHo6ydEYFv796PqfPqqShtoy5NaUU5OexrznEwxsO8fCGwxxOjEAK8423LpvJ1avm8eYz6l9x7oa70xuN0RaOxC+hKG3hCK2hCC2hCK2hPlpDESL9MSqKC6gsKaSqtIDq0kKWzapi+fwaqksL0/VrkYT+gRiH23vY2xziQEuY4529NHX1nTywIj/PaKgtZ1Fd/NJQV86sqhLqKooomMJzeTp7o5TVTacg1D1646oq6OgIPqgM1Bsd4KENh7j36X3sbQ7x0Ysa+Lv3vC7dYY3KzNa7++pTeqwSxeTpjQ7wyKYjfO+3jbx4+OX6hwV5Rn1lMUc7eskzuGhJHdesmkdDbTmPbDrCTzYeprk7Qk1ZIdPKighH+glHBghHBhiIJX99zKCmtJDp5UUUFeTT1Rulq7efrt4oQx+yZEYFK+fXvGqxzQzmTytjyYwKFtWVU1KYf8r97usfoKU7QnN3Hy3dEcqLC1g2u5KqkvEnqYHEaOuxLUfoiQxQW1FMbUURdeXF1FUWMbOqhFlVJUwvL3rVpzh3J+aMeFRaWyjCb/e2cLA1TF1FMTOrSphRVcyMymKqSgon/F0C/QMxGlvCvHSsi5eOdbLjWBe7m7o52BomOvDyi1KQZ9RVFJ88pyc6EGNfc4jD7T0M/Xc0g9ryYmZWFTO9vIiq0kKqSgqpKilgWnkRy2ZVcs7campPYdojOhBj+9FOXjjQzqZD7Ww62M6ephB7b34PeYz+nhAz40fPNbK6YRqn1Vfk/CdqiP+d3/nrvdz320ZaQxHOmVvNDZcu5l1nz5rShH6qlCgyjLtzoquP/S1hGltC7G8JcaithzNnV3HVirnMqn7lt2BFB2I8vauJxzYfIzIQo6wwn9KifMqK8ikvLmB6eRHTyooSP+PJoaasKOkborvT2dPPlsMdvHCgjRcOtvPCgTbawiNPJ+QZzJ9exqK6cuZNK2XetDLmTStlRmUJ7eEIx7v6ONHZy/HOXlpDUbp6o3T29tPZE6UzkaCSmTetlDNnV7FsViWn1VewuD7+iblySAKJxZyuvn72NYd4ZOMRHt18hKauPiqL42+GLd19hJIcMFCUn8eMqmLMoCeRVHuiA+SbsbA2ngCXzKhgYW05e5q6+c3uZrYe6WSkP/c8g6rSQqoTl5lVJSyfV83y+TWcO7eG6rKXY+7rH6AtFOVgW5htRzrZfrSTbUc7eelYF339sZP7a6grZ+mMChbXV7CotpxF9eUsrC2jrrw4aVLqjQ5wsDXM/pYwx7t6Od7ZR1PiZ1s4kvh999PREyXS/3LB5bk1pZw9t4rXL5jGBafV8ro51a/62zjW0cumQ+28cKCdDQfa2Hyond5ofB91FcWsmF/D8nnV/Ol7Xz+mEUV3cRlnf/pHANSUFbJifg1LZ1RwWn3Fyd99TVnRKHvJLl9+ZCvffbaRty6bwQ2XLuYNi6ZnVYJUopCU3J2+/hiDf9OG0R+L0dgcZndTN7tPdLPnRDf7W+MJrT1JUsmz+BvK8E+2VaWF1JYXUVdZfPL+jp4I2492sf1o/E10X3PoFaOcuopiigvy6OyN0t3Xf/LNuyg/j7csq+eqFXN5y7IZJ0c5PZEBWkLxaZrjnb0c6+jlaGcvJzr7cHdKiwooSyTW6ICzt6mbPU3d7G8J0x9zCvONlQumcdFpdVy8tJalMytp6Y5worOXE4l9dvRE6eiJ0h6O/zzYGmZv4ogWgAXTy4i50xaKvCpxTSsr5Kw5VZw5q4plicS4ZEbFhEZpo+noibL1SAcvHu5g86EOthzuYH9LGIDK4gLOXzSdM2ZVsvN4N5sPtXOiqw+IT3WeNaeaVQum8fqFNaxcMI051SUvv+F94hPxo5tSrVMUFuI33MDeL9/M+sY21u1vZfOhDvY2h16RwC5eUsdNb1vKeQ3TA/s9TJWndzVx3b3P85ELG/jylZk/zZSMEoVMqq7eKIfbezjR2ce0siJmVhVTW1F8yicaDn5S3tscYl9ziH1NIfpjTmUi0VSVFFBfWcybz5gxqWsqkf742sDMquJTOqu+oyfKi4c72HiwnW1HOikqyGNaWRG1FfER3uzqEs6cXcXMquKM+GR5orOX5/a18ts9Lazd28K+lhCL6spZPq+Gc+dVc+68Gl43pyp1AtuzJ34IbDg8cpuyMti8+VXnUwzEnMNtPexu6mLLoU6+/1wjzd0RLlhcy01vW8obF9dOuI9PbDvOpoPt/NlbllBaFFwiHqojHOWd31xDeXE+j33qkkA/AARJiUJEXiU6EDu1wpaPPx4/BDYafeXIorAwfnnwQbjiilF30xMZ4P61+7lrzV6auvq4aEkt//i+c1h4imcxH27v4R23PUUoMsDSGRXc8UcrOXN21SntazxueuAFHtt8lIc/cSHnzqsJ/PmCMpFEkfkrMCJySk65+vEVV8RHDDfeGD+6KS8v/vPGG+Pbx5AkAEqL8vmTSxbz9F+9hS+9+yw2H+rgin9+mu//tpHYCAdpjMTd+eKPtxBzuOWac2nvifLef/sN3/3NvlEPR5+IRzcd4Scbj/DJy5ZmdZKYKI0oRGRKHO3o4a8e3MzTu5q5aEktN199LnNrSmkJRdh1vJtdJ7qoLi3kyuVzXjWV9+MXDvGZH27iS+8+i49dvIiW7j7+8sHN/M+OE1y2bAb/9P5zmFlVMsIzn5pjHb2885traKgr56GPX5AVRzaloqknEckK7s5/Pn+Qf3hsG068ivPwI/Le//q5/NP7z6G4IL4W0Nzdx9tve4qGunIe/PiFJ9fK3J37nm3kHx/fQUGe8WdvWcL1Fy+alDWEjnCUj933O7Ye6eC/P3UJi+srJrzPdJtIonjNFAUUkfQzMz7whgVcsrSOf/7VLgrz81g6o4LTZ8aPFPvh7w5y+y93cqAlzJ3XraKuopivPLqNUN8A37j63FccUGFmfOSiRVy2bCZ//9g2bvn5S/zwdwf54u+dyTvOmnnKBxgcbA3zke88z4HWMLf/wYqcSBITpRGFiGSUxzYf5XP/tZHa8mL++IKF/NPjO/jM207nprctTfm4Z3Y189WfbmXn8W7OXzSdGy9ZzGXLZozrRMqNB9v5k/t+R3TAueu6VZNypFam0NSTiOSUzYfaueF76zje2ccZMyt59JMXU1Qw+hpB/0CM+9ce4K6n9nCko5dFdeV89KIGrlk1b9RDpH++9Rg3PfAC9ZXFfOcj57NkRm6NJJQoRCTnHOvo5fYndvLRixtYNmt8h8FGB2L87MVj3PvMPjYebKeypIALFtdy/qLprG6YzuvmVDEQc9Y1tvH0ribW7Gpm+9FOVsyv4Z4Pr6YuB6vBKlGIiIxg/f42Hnj+AM83tp48e72kMD466Y3GKMw3Vi+czpvOqOfDFzRM2Yl8U02L2SIiI1i1cBqrFk4D4mevr9vfxu8aWzGMS5bW8YbF00/pzP3XEv12ROQ1Y0ZVCe86ZzbvOmd2ukPJKtl9BomIiAROiUJERFJSohARkZSUKEREJCUlChERSUmJQkREUlKiEBGRlJQoREQkpawr4WFmTcD+MTStBjom2C7ZfaNtG37/4O2h2+uA5jHElor6N3q7sfQv1e2Rrqt/o1P/xt+3ZNsns38L3b1+lJiTc/ecvAB3T7RdsvtG2zb8/sHbw9qsU/8yo3+pbqe4rv6pf6P2b7x9y6T+Db/k8tTTo5PQLtl9o20bfv+jI2yfKPVv9HZj6V+q26n6PVHq3+jtsr1/4+1bsu3p6t8rZN3UUy4ws3V+ilUcs4H6l93Uv+wWRP9yeUSRye5OdwABU/+ym/qX3Sa9fxpRiIhIShpRiIhISkoUIiKSkhLFBJnZt83shJm9eAqPXWVmW8xst5ndYWY25L5PmtkOM9tqZt+Y3KjHFeOk98/Mvmxmh81sY+LyrsmPfMwxBvL6Je7/nJm5mdVNXsTjjjGI1+9rZrY58dr9wszmTH7kY44xiP7dkvjf22xmPzazmsmPfEzxBdG3axPvKTEzG/uC92Qfb/tauwCXAq8HXjyFxz4PvBEw4HHgisT2twC/BIoTt2fkWP++DPxFul+7oPqXuG8+8HPiJ4fW5VL/gKohbT4F3Jlj/XsHUJC4fjNwcw717UzgDODXwOqx7k8jigly9zVA69BtZnaamf3MzNab2dNmtmz448xsNvF/uOc8/gp+D7gqcfefAl93977Ec5wIthcjC6h/GSPA/t0O/BWQ1qNFguifu3cOaVpOGvsYUP9+4e79iabPAfOC7UVyAfVtu7u/NN5YlCiCcTfwSXdfBfwF8O9J2swFDg25fSixDeB04BIzW2tmT5nZeYFGO34T7R/AnyeG9t82s2nBhXpKJtQ/M3svcNjdNwUd6Cma8OtnZv9gZgeBDwJfCjDWUzEZf5+DPkb8E3mmmMy+jVnBRB4sr2ZmFcCFwH8NmbIuHuduCoDpxIeO5wE/MrPFiU8HaTVJ/fsW8DXin8xYt2YAAARPSURBVES/BtxK/B8y7SbaPzMrA75AfPoi40zS64e7fxH4opn9NfDnwN9NWpATMFn9S+zri0A/cP/kRDcxk9m38VKimHx5QLu7rxi60czygfWJm48Qf7McOqSdBxxOXD8EPJxIDM+bWYx4oa+mIAMfown3z92PD3nc/wV+GmTA4zTR/p0GLAI2Jf6Z5wEbzOx8dz8WcOxjMRl/n0PdD/w3GZIomKT+mdlHgHcDb82ED2gJk/3ajV06Fmly7QI0MGTBCXgWuDZx3YDlIzxu+ILTuxLbPw58NXH9dOAgiZMjc6R/s4e0+QzwQC69fsPaNJLGxeyAXr+lQ9p8Engwx/p3ObANqE9nv4L822Sci9lp/SXkwgX4T+AoECU+Erie+CfKnwGbEn9wXxrhsauBF4E9wL8OJgOgCPiPxH0bgMtyrH/fB7YAm4l/Apo9Vf2Ziv4Na5PWRBHQ6/dQYvtm4sXo5uZY/3YT/3C2MXFJy1FdAfXtfYl99QHHgZ+PJRaV8BARkZR01JOIiKSkRCEiIikpUYiISEpKFCIikpIShYiIpKREITnBzLqn+PmenaT9vNnMOhKVWHeY2f8Zw2OuMrOzJuP5RcZCiUIkCTNLWbXA3S+cxKd72uNn264E3m1mF43S/ipAiUKmjEp4SM4ys9OAfwPqgTBwg7vvMLP3AH9D/MTGFuCD7n7czL4MzCF+Nmyzme0EFgCLEz+/6e53JPbd7e4VZvZm4mXTm4GziZdS+JC7u8W/Z+O2xH0bgMXu/u6R4nX3HjPbyMvFBW8AbkzEuRu4DlgBXAm8ycz+Brg68fBX9XMCvzqRV9CIQnLZSJU2nwHe6O4rgQeIlwMftAp4r7t/IHF7GfBO4Hzg78ysMMnzrAQ+TfxT/mLgIjMrAe4i/j0AFxN/E08pUUV3KbAmselhdz/P3ZcD24Hr3f1Z4mez/6W7r3D3PSn6KTIpNKKQnDRKpc15wA8TdfuLgH1DHvqIu/cMuf2Yx78XpM/MTgAzeWUJZ4Dn3f1Q4nk3Eh+RdAN73X1w3/9JfHSQzCVmtpn4F8p83V8uHni2mf09UANUEP8ipPH0U2RSKFFIrkpaaTPhX4Db3P2RIVNHg0LD2vYNuT5A8v+ZsbRJ5Wl3f7eZnQ48bWY/dveNwHeBq9x9U6Ka6ZuTPDZVP0UmhaaeJCd5/FvY9pnZtQAWtzxxdzUvl13+cEAhvAQsNrOGxO0/GO0B7r4T+Drw+cSmSuBoYrrrg0OadiXuG62fIpNCiUJyRZmZHRpy+SzxN9frzWwTsBV4b6Ltl4lP1TxNfKF50iWmrz4B/MzMniFeqbNjDA+9E7g0kWD+FlgLPAEMXZx+APhLM3shsWA/Uj9FJoWqx4oExMwq3L3b4osH/wbscvfb0x2XyHhpRCESnBsSi9tbiU933ZXmeEROiUYUIiKSkkYUIiKSkhKFiIikpEQhIiIpKVGIiEhKShQiIpLS/wfd56nitvKnBQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "0.001202264434617413"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.lr_find()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Training the model is an iterative process. We can train the model using its `fit()` method till the validation loss (or error rate) continues to go down with each training pass also known as an epoch. This is indicative of the model learning the task."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: left;\">\n",
       "      <th>epoch</th>\n",
       "      <th>train_loss</th>\n",
       "      <th>valid_loss</th>\n",
       "      <th>accuracy</th>\n",
       "      <th>error_rate</th>\n",
       "      <th>time</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>0.308638</td>\n",
       "      <td>0.182150</td>\n",
       "      <td>0.929600</td>\n",
       "      <td>0.070400</td>\n",
       "      <td>05:28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1</td>\n",
       "      <td>0.103615</td>\n",
       "      <td>0.068711</td>\n",
       "      <td>0.970600</td>\n",
       "      <td>0.029400</td>\n",
       "      <td>05:46</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2</td>\n",
       "      <td>0.076326</td>\n",
       "      <td>0.041269</td>\n",
       "      <td>0.981600</td>\n",
       "      <td>0.018400</td>\n",
       "      <td>05:30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3</td>\n",
       "      <td>0.055707</td>\n",
       "      <td>0.034307</td>\n",
       "      <td>0.986300</td>\n",
       "      <td>0.013700</td>\n",
       "      <td>05:33</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4</td>\n",
       "      <td>0.041812</td>\n",
       "      <td>0.032772</td>\n",
       "      <td>0.986400</td>\n",
       "      <td>0.013600</td>\n",
       "      <td>05:27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5</td>\n",
       "      <td>0.049993</td>\n",
       "      <td>0.032165</td>\n",
       "      <td>0.986600</td>\n",
       "      <td>0.013400</td>\n",
       "      <td>05:26</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model.fit(epochs=6, lr=0.001)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Validate results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Once we have the trained model, we can see the results to see how it performs."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070 th {\n",
       "          text-align: left;\n",
       "    }#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row0_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row0_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row0_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row1_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row1_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row1_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row2_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row2_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row2_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row3_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row3_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row3_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row4_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row4_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row4_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row5_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row5_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row5_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row6_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row6_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row6_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row7_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row7_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row7_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row8_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row8_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row8_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row9_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row9_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row9_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row10_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row10_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row10_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row11_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row11_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row11_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row12_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row12_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row12_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row13_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row13_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row13_col2,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row14_col0,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row14_col1,#T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row14_col2{\n",
       "            text-align:  left;\n",
       "        }</style><table id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070\" ><thead>    <tr>        <th class=\"col_heading level0 col0\" >text</th>        <th class=\"col_heading level0 col1\" >target</th>        <th class=\"col_heading level0 col2\" >prediction</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row0_col0\" class=\"data row0 col0\" >SN, AVENIDA JOSE MARIA MORELOS Y PAVON OTE., APATZINGÁN DE LA CONSTITUCIÓN, Apatzingán, Michoacán de Ocampo</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row0_col1\" class=\"data row0 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row0_col2\" class=\"data row0 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row1_col0\" class=\"data row1 col0\" >906, AVENIDA JOSEFA ORTÍZ DE DOMÍNGUEZ, CIUDAD MENDOZA, Camerino Z. Mendoza, Veracruz de Ignacio de la Llave</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row1_col1\" class=\"data row1 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row1_col2\" class=\"data row1 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row2_col0\" class=\"data row2 col0\" >32, CIRCUITO JOSÉ MARÍA URIARTE, FRACCIONAMIENTO RANCHO ALEGRE, Tlajomulco de Zúñiga, Jalisco</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row2_col1\" class=\"data row2 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row2_col2\" class=\"data row2 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row3_col0\" class=\"data row3 col0\" >SN, ESTRADA SP 250 SENTIDO GRAMADAO, LADO DIREITO FAZENDA SAO RAFAEL CASA 4, São Miguel Arcanjo, SP, 18230-000</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row3_col1\" class=\"data row3 col1\" >BR</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row3_col2\" class=\"data row3 col2\" >BR</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row4_col0\" class=\"data row4 col0\" >SN, CALLE JOSEFA ORTÍZ DE DOMÍNGUEZ, RINCÓN DE BUENA VISTA, Omealca, Veracruz de Ignacio de la Llave</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row4_col1\" class=\"data row4 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row4_col2\" class=\"data row4 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row5_col0\" class=\"data row5 col0\" >SN, CALLE MICHOACAN, DOLORES HIDALGO CUNA DE LA INDEPENDENCIA NACIONAL, Dolores Hidalgo Cuna de la Independencia Nacional, Guanajuato</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row5_col1\" class=\"data row5 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row5_col2\" class=\"data row5 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row6_col0\" class=\"data row6 col0\" >SN, CALLE VERDUZCO, COALCOMÁN DE VÁZQUEZ PALLARES, Coalcomán de Vázquez Pallares, Michoacán de Ocampo</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row6_col1\" class=\"data row6 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row6_col2\" class=\"data row6 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row7_col0\" class=\"data row7 col0\" >1712, CALLE MÁRTIRES DEL 7 DE ENERO, CIUDAD MENDOZA, Camerino Z. Mendoza, Veracruz de Ignacio de la Llave</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row7_col1\" class=\"data row7 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row7_col2\" class=\"data row7 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row8_col0\" class=\"data row8 col0\" >SN, AVENIDA JACOBO GÁLVEZ, FRACCIONAMIENTO RANCHO ALEGRE, Tlajomulco de Zúñiga, Jalisco</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row8_col1\" class=\"data row8 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row8_col2\" class=\"data row8 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row9_col0\" class=\"data row9 col0\" >SN, ANDADOR MZNA 6 AMP. LOS ROBLES, EL PUEBLITO (CRUCERO NACIONAL), Córdoba, Veracruz de Ignacio de la Llave</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row9_col1\" class=\"data row9 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row9_col2\" class=\"data row9 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row10_col0\" class=\"data row10 col0\" >SN, CALLE SÉPTIMA PONIENTE SUR (EJE VIAL), COMITÁN DE DOMÍNGUEZ, Comitán de Domínguez, Chiapas</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row10_col1\" class=\"data row10 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row10_col2\" class=\"data row10 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row11_col0\" class=\"data row11 col0\" >18, CALLE FELIPE GORRITI / FELIPE GORRITI KALEA, Pamplona / Iruña, Pamplona / Iruña, Navarra, 31004</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row11_col1\" class=\"data row11 col1\" >ES</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row11_col2\" class=\"data row11 col2\" >ES</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row12_col0\" class=\"data row12 col0\" >SN, RUA X VINTE E SEIS, QUADRA 14 LOTE 35 SALA 3, Aparecida de Goiânia, GO, 74922-680</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row12_col1\" class=\"data row12 col1\" >BR</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row12_col2\" class=\"data row12 col2\" >BR</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row13_col0\" class=\"data row13 col0\" >SN, CALLE NINGUNO, HEROICA CIUDAD DE JUCHITÁN DE ZARAGOZA, Heroica Ciudad de Juchitán de Zaragoza, Oaxaca</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row13_col1\" class=\"data row13 col1\" >MX</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row13_col2\" class=\"data row13 col2\" >MX</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row14_col0\" class=\"data row14 col0\" >1169, RUA DOUTOR ALBUQUERQUE LINS, BLOCO B ANDAR 11 APARTAMENTO 112B, São Paulo, SP, 01203-001</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row14_col1\" class=\"data row14 col1\" >BR</td>\n",
       "                        <td id=\"T_eca9ff1e_33ab_11eb_b034_a4bb6dafa070row14_col2\" class=\"data row14 col2\" >BR</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x20ebbd53bc8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model.show_results(15)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Test the model prediction on an input text"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "('1016, 8A, CL RICARDO LEON - SANTA ANA (CARTAGENA), 30319', 'ES', 1.0)\n"
     ]
    }
   ],
   "source": [
    "text = \"\"\"1016, 8A, CL RICARDO LEON - SANTA ANA (CARTAGENA), 30319\"\"\"\n",
    "print(model.predict(text))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Model metrics\n",
    "\n",
    "To get a sense of how well the model is trained, we will calculate some important metrics for our `text-classifier` model. First, to find how accurate[[2]](#References) the model is in correctly predicting the classes in the dataset, we will call the model's `accuracy()` method."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0.9866"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.accuracy()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Other important metrics to look at are Precision, Recall & F1-measures [[3]](#References). To find `precision`, `recall` & `f1` scores per label/class we will call the model's `metrics_per_label()` method."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "    <div>\n",
       "        <style>\n",
       "            /* Turns off some styling */\n",
       "            progress {\n",
       "                /* gets rid of default border in Firefox and Opera. */\n",
       "                border: none;\n",
       "                /* Needs to be in here for Safari polyfill so background images work as expected. */\n",
       "                background-size: auto;\n",
       "            }\n",
       "            .progress-bar-interrupted, .progress-bar-interrupted::-webkit-progress-bar {\n",
       "                background: #F44336;\n",
       "            }\n",
       "        </style>\n",
       "      <progress value='10000' class='' max='10000' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
       "      100.00% [10000/10000 05:05<00:00]\n",
       "    </div>\n",
       "    "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Precision_score</th>\n",
       "      <th>Recall_score</th>\n",
       "      <th>F1_score</th>\n",
       "      <th>Support</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>AU</th>\n",
       "      <td>1.0000</td>\n",
       "      <td>1.0000</td>\n",
       "      <td>1.0000</td>\n",
       "      <td>929.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BE</th>\n",
       "      <td>0.9990</td>\n",
       "      <td>0.9990</td>\n",
       "      <td>0.9990</td>\n",
       "      <td>1043.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BR</th>\n",
       "      <td>1.0000</td>\n",
       "      <td>1.0000</td>\n",
       "      <td>1.0000</td>\n",
       "      <td>950.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>CA</th>\n",
       "      <td>0.9088</td>\n",
       "      <td>0.9709</td>\n",
       "      <td>0.9388</td>\n",
       "      <td>996.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ES</th>\n",
       "      <td>0.9969</td>\n",
       "      <td>0.9980</td>\n",
       "      <td>0.9975</td>\n",
       "      <td>982.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FR</th>\n",
       "      <td>1.0000</td>\n",
       "      <td>0.9990</td>\n",
       "      <td>0.9995</td>\n",
       "      <td>1009.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>JP</th>\n",
       "      <td>1.0000</td>\n",
       "      <td>0.9990</td>\n",
       "      <td>0.9995</td>\n",
       "      <td>989.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MX</th>\n",
       "      <td>1.0000</td>\n",
       "      <td>1.0000</td>\n",
       "      <td>1.0000</td>\n",
       "      <td>1024.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>US</th>\n",
       "      <td>0.9691</td>\n",
       "      <td>0.9093</td>\n",
       "      <td>0.9383</td>\n",
       "      <td>1070.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ZA</th>\n",
       "      <td>0.9990</td>\n",
       "      <td>0.9980</td>\n",
       "      <td>0.9985</td>\n",
       "      <td>1008.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    Precision_score  Recall_score  F1_score  Support\n",
       "AU           1.0000        1.0000    1.0000    929.0\n",
       "BE           0.9990        0.9990    0.9990   1043.0\n",
       "BR           1.0000        1.0000    1.0000    950.0\n",
       "CA           0.9088        0.9709    0.9388    996.0\n",
       "ES           0.9969        0.9980    0.9975    982.0\n",
       "FR           1.0000        0.9990    0.9995   1009.0\n",
       "JP           1.0000        0.9990    0.9995    989.0\n",
       "MX           1.0000        1.0000    1.0000   1024.0\n",
       "US           0.9691        0.9093    0.9383   1070.0\n",
       "ZA           0.9990        0.9980    0.9985   1008.0"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.metrics_per_label()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Get misclassified records\n",
    "\n",
    "Its always a good idea to see the cases where your model is not performing well. This step will help us to:\n",
    "- Identify if there is a problem in the dataset.\n",
    "- Identify if there is a problem with text/documents belonging to a specific label/class.  \n",
    "- Identify if there is a class imbalance in your dataset, due to which the model didn't see much of the labeled data for a particular class, hence not able to learn properly about that class.\n",
    "\n",
    "To get the **misclassified records** we will call the model's `get_misclassified_records` method."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "    <div>\n",
       "        <style>\n",
       "            /* Turns off some styling */\n",
       "            progress {\n",
       "                /* gets rid of default border in Firefox and Opera. */\n",
       "                border: none;\n",
       "                /* Needs to be in here for Safari polyfill so background images work as expected. */\n",
       "                background-size: auto;\n",
       "            }\n",
       "            .progress-bar-interrupted, .progress-bar-interrupted::-webkit-progress-bar {\n",
       "                background: #F44336;\n",
       "            }\n",
       "        </style>\n",
       "      <progress value='10000' class='' max='10000' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
       "      100.00% [10000/10000 05:07<00:00]\n",
       "    </div>\n",
       "    "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "misclassified_records = model.get_misclassified_records()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_7224c262_33ad_11eb_b039_a4bb6dafa070 th {\n",
       "          text-align: left;\n",
       "    }#T_7224c262_33ad_11eb_b039_a4bb6dafa070row0_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row0_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row0_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row1_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row1_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row1_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row2_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row2_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row2_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row3_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row3_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row3_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row4_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row4_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row4_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row5_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row5_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row5_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row6_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row6_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row6_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row7_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row7_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row7_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row8_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row8_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row8_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row9_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row9_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row9_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row10_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row10_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row10_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row11_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row11_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row11_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row12_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row12_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row12_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row13_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row13_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row13_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row14_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row14_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row14_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row15_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row15_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row15_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row16_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row16_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row16_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row17_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row17_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row17_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row18_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row18_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row18_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row19_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row19_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row19_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row20_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row20_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row20_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row21_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row21_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row21_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row22_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row22_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row22_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row23_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row23_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row23_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row24_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row24_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row24_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row25_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row25_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row25_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row26_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row26_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row26_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row27_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row27_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row27_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row28_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row28_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row28_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row29_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row29_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row29_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row30_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row30_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row30_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row31_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row31_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row31_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row32_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row32_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row32_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row33_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row33_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row33_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row34_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row34_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row34_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row35_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row35_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row35_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row36_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row36_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row36_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row37_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row37_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row37_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row38_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row38_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row38_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row39_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row39_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row39_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row40_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row40_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row40_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row41_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row41_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row41_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row42_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row42_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row42_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row43_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row43_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row43_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row44_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row44_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row44_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row45_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row45_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row45_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row46_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row46_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row46_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row47_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row47_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row47_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row48_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row48_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row48_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row49_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row49_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row49_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row50_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row50_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row50_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row51_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row51_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row51_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row52_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row52_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row52_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row53_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row53_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row53_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row54_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row54_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row54_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row55_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row55_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row55_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row56_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row56_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row56_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row57_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row57_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row57_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row58_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row58_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row58_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row59_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row59_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row59_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row60_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row60_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row60_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row61_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row61_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row61_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row62_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row62_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row62_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row63_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row63_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row63_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row64_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row64_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row64_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row65_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row65_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row65_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row66_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row66_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row66_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row67_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row67_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row67_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row68_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row68_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row68_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row69_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row69_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row69_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row70_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row70_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row70_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row71_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row71_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row71_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row72_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row72_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row72_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row73_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row73_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row73_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row74_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row74_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row74_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row75_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row75_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row75_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row76_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row76_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row76_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row77_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row77_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row77_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row78_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row78_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row78_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row79_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row79_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row79_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row80_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row80_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row80_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row81_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row81_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row81_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row82_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row82_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row82_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row83_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row83_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row83_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row84_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row84_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row84_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row85_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row85_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row85_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row86_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row86_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row86_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row87_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row87_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row87_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row88_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row88_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row88_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row89_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row89_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row89_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row90_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row90_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row90_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row91_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row91_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row91_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row92_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row92_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row92_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row93_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row93_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row93_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row94_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row94_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row94_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row95_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row95_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row95_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row96_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row96_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row96_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row97_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row97_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row97_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row98_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row98_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row98_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row99_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row99_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row99_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row100_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row100_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row100_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row101_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row101_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row101_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row102_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row102_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row102_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row103_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row103_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row103_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row104_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row104_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row104_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row105_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row105_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row105_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row106_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row106_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row106_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row107_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row107_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row107_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row108_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row108_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row108_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row109_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row109_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row109_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row110_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row110_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row110_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row111_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row111_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row111_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row112_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row112_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row112_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row113_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row113_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row113_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row114_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row114_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row114_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row115_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row115_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row115_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row116_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row116_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row116_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row117_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row117_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row117_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row118_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row118_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row118_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row119_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row119_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row119_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row120_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row120_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row120_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row121_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row121_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row121_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row122_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row122_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row122_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row123_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row123_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row123_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row124_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row124_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row124_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row125_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row125_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row125_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row126_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row126_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row126_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row127_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row127_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row127_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row128_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row128_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row128_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row129_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row129_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row129_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row130_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row130_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row130_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row131_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row131_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row131_col2,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row132_col0,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row132_col1,#T_7224c262_33ad_11eb_b039_a4bb6dafa070row132_col2{\n",
       "            text-align:  left;\n",
       "        }</style><table id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070\" ><thead>    <tr>        <th class=\"col_heading level0 col0\" >Address</th>        <th class=\"col_heading level0 col1\" >Target</th>        <th class=\"col_heading level0 col2\" >Prediction</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row0_col0\" class=\"data row0 col0\" >107, HAMILTON CT, EASLEY</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row0_col1\" class=\"data row0 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row0_col2\" class=\"data row0 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row1_col0\" class=\"data row1 col0\" >40443, CHEAKAMUS WAY</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row1_col1\" class=\"data row1 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row1_col2\" class=\"data row1 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row2_col0\" class=\"data row2 col0\" >309, SOUTH STREET, BARABOO</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row2_col1\" class=\"data row2 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row2_col2\" class=\"data row2 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row3_col0\" class=\"data row3 col0\" >19109, DUTY ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row3_col1\" class=\"data row3 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row3_col2\" class=\"data row3 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row4_col0\" class=\"data row4 col0\" >8171, CR 29, 43357</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row4_col1\" class=\"data row4 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row4_col2\" class=\"data row4 col2\" >ES</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row5_col0\" class=\"data row5 col0\" >6565, WISCONSIN AVE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row5_col1\" class=\"data row5 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row5_col2\" class=\"data row5 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row6_col0\" class=\"data row6 col0\" >7332, 25TH AVENUE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row6_col1\" class=\"data row6 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row6_col2\" class=\"data row6 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row7_col0\" class=\"data row7 col0\" >14778, CAMINITO PUNTA ARENAS, Del Mar, 92014</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row7_col1\" class=\"data row7 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row7_col2\" class=\"data row7 col2\" >ES</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row8_col0\" class=\"data row8 col0\" >916, PINE ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row8_col1\" class=\"data row8 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row8_col2\" class=\"data row8 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row9_col0\" class=\"data row9 col0\" >168, BROAD SOUND PL, Iredell</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row9_col1\" class=\"data row9 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row9_col2\" class=\"data row9 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row10_col0\" class=\"data row10 col0\" >316, BEAUMIER LANE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row10_col1\" class=\"data row10 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row10_col2\" class=\"data row10 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row11_col0\" class=\"data row11 col0\" >1518, BARCLAY ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row11_col1\" class=\"data row11 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row11_col2\" class=\"data row11 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row12_col0\" class=\"data row12 col0\" >235, GLADEFIELD DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row12_col1\" class=\"data row12 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row12_col2\" class=\"data row12 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row13_col0\" class=\"data row13 col0\" >2701, CURRANT CV</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row13_col1\" class=\"data row13 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row13_col2\" class=\"data row13 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row14_col0\" class=\"data row14 col0\" >94, ASPETUCK VILLAGE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row14_col1\" class=\"data row14 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row14_col2\" class=\"data row14 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row15_col0\" class=\"data row15 col0\" >27, South  10Th Avenue</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row15_col1\" class=\"data row15 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row15_col2\" class=\"data row15 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row16_col0\" class=\"data row16 col0\" >254, GREEN HILLS DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row16_col1\" class=\"data row16 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row16_col2\" class=\"data row16 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row17_col0\" class=\"data row17 col0\" >1025, BROOKFORD RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row17_col1\" class=\"data row17 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row17_col2\" class=\"data row17 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row18_col0\" class=\"data row18 col0\" >8981, FAIRMOUNT RD SE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row18_col1\" class=\"data row18 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row18_col2\" class=\"data row18 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row19_col0\" class=\"data row19 col0\" >5, PICKWICK LA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row19_col1\" class=\"data row19 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row19_col2\" class=\"data row19 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row20_col0\" class=\"data row20 col0\" >540, CHARLESTON HWY</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row20_col1\" class=\"data row20 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row20_col2\" class=\"data row20 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row21_col0\" class=\"data row21 col0\" >1763, RD, McDowell</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row21_col1\" class=\"data row21 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row21_col2\" class=\"data row21 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row22_col0\" class=\"data row22 col0\" >40022, GOVERNMENT RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row22_col1\" class=\"data row22 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row22_col2\" class=\"data row22 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row23_col0\" class=\"data row23 col0\" >435, EMORY RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row23_col1\" class=\"data row23 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row23_col2\" class=\"data row23 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row24_col0\" class=\"data row24 col0\" >1, Bokomo Road, Malmesbury, Swartland</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row24_col1\" class=\"data row24 col1\" >ZA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row24_col2\" class=\"data row24 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row25_col0\" class=\"data row25 col0\" >3529, BRADLEY AVE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row25_col1\" class=\"data row25 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row25_col2\" class=\"data row25 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row26_col0\" class=\"data row26 col0\" >710, 9TH ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row26_col1\" class=\"data row26 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row26_col2\" class=\"data row26 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row27_col0\" class=\"data row27 col0\" >1421, PINOT NOIR DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row27_col1\" class=\"data row27 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row27_col2\" class=\"data row27 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row28_col0\" class=\"data row28 col0\" >1224, ST LUKE RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row28_col1\" class=\"data row28 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row28_col2\" class=\"data row28 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row29_col0\" class=\"data row29 col0\" >1822, RT 6</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row29_col1\" class=\"data row29 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row29_col2\" class=\"data row29 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row30_col0\" class=\"data row30 col0\" >140</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row30_col1\" class=\"data row30 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row30_col2\" class=\"data row30 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row31_col0\" class=\"data row31 col0\" >2302, RIVER MIST RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row31_col1\" class=\"data row31 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row31_col2\" class=\"data row31 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row32_col0\" class=\"data row32 col0\" >4159, Maher St</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row32_col1\" class=\"data row32 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row32_col2\" class=\"data row32 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row33_col0\" class=\"data row33 col0\" >24, DEARBORN STREET, Franklin</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row33_col1\" class=\"data row33 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row33_col2\" class=\"data row33 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row34_col0\" class=\"data row34 col0\" >2109, MALDON PL</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row34_col1\" class=\"data row34 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row34_col2\" class=\"data row34 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row35_col0\" class=\"data row35 col0\" >Flora Road, Moquini Coastal Estate, Mossel Bay</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row35_col1\" class=\"data row35 col1\" >ZA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row35_col2\" class=\"data row35 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row36_col0\" class=\"data row36 col0\" >5990, THIROS CIR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row36_col1\" class=\"data row36 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row36_col2\" class=\"data row36 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row37_col0\" class=\"data row37 col0\" >167, CARLSBAD CAVERNS ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row37_col1\" class=\"data row37 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row37_col2\" class=\"data row37 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row38_col0\" class=\"data row38 col0\" >2119, E 3RD AV</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row38_col1\" class=\"data row38 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row38_col2\" class=\"data row38 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row39_col0\" class=\"data row39 col0\" >505, HARLEY WAY, SHARON</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row39_col1\" class=\"data row39 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row39_col2\" class=\"data row39 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row40_col0\" class=\"data row40 col0\" >1354, ST LUKE RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row40_col1\" class=\"data row40 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row40_col2\" class=\"data row40 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row41_col0\" class=\"data row41 col0\" >3140, SOUTHWOOD RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row41_col1\" class=\"data row41 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row41_col2\" class=\"data row41 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row42_col0\" class=\"data row42 col0\" >4205, Glenn</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row42_col1\" class=\"data row42 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row42_col2\" class=\"data row42 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row43_col0\" class=\"data row43 col0\" >103, BILLETS BRIDGE RD, Courthouse, Camden</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row43_col1\" class=\"data row43 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row43_col2\" class=\"data row43 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row44_col0\" class=\"data row44 col0\" >838087, 4TH LINE EAST, TOWNSHIP OF MULMUR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row44_col1\" class=\"data row44 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row44_col2\" class=\"data row44 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row45_col0\" class=\"data row45 col0\" >3317, Doncaster DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row45_col1\" class=\"data row45 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row45_col2\" class=\"data row45 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row46_col0\" class=\"data row46 col0\" >2726, E TRUESDALE DRIVE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row46_col1\" class=\"data row46 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row46_col2\" class=\"data row46 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row47_col0\" class=\"data row47 col0\" >2131, SHAMROCK DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row47_col1\" class=\"data row47 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row47_col2\" class=\"data row47 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row48_col0\" class=\"data row48 col0\" >1185, ST ANNES RD, Unit 99</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row48_col1\" class=\"data row48 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row48_col2\" class=\"data row48 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row49_col0\" class=\"data row49 col0\" >9109, CONTESSA CT</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row49_col1\" class=\"data row49 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row49_col2\" class=\"data row49 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row50_col0\" class=\"data row50 col0\" >408, RUBY RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row50_col1\" class=\"data row50 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row50_col2\" class=\"data row50 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row51_col0\" class=\"data row51 col0\" >2101, FONTAINE RD, 10</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row51_col1\" class=\"data row51 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row51_col2\" class=\"data row51 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row52_col0\" class=\"data row52 col0\" >52, OLD HWY</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row52_col1\" class=\"data row52 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row52_col2\" class=\"data row52 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row53_col0\" class=\"data row53 col0\" >200, EAGLE SHORE DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row53_col1\" class=\"data row53 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row53_col2\" class=\"data row53 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row54_col0\" class=\"data row54 col0\" >1450, MEADOW AV</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row54_col1\" class=\"data row54 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row54_col2\" class=\"data row54 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row55_col0\" class=\"data row55 col0\" >0, BEECH ST, Rockingham</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row55_col1\" class=\"data row55 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row55_col2\" class=\"data row55 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row56_col0\" class=\"data row56 col0\" >291, SPRY POINT RD, LITTLE POND, KNS</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row56_col1\" class=\"data row56 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row56_col2\" class=\"data row56 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row57_col0\" class=\"data row57 col0\" >10905, YORKTOWN CV</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row57_col1\" class=\"data row57 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row57_col2\" class=\"data row57 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row58_col0\" class=\"data row58 col0\" >3903, TATTLE BRANCH RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row58_col1\" class=\"data row58 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row58_col2\" class=\"data row58 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row59_col0\" class=\"data row59 col0\" >682, ISLAND 90 SIX MILE LAKE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row59_col1\" class=\"data row59 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row59_col2\" class=\"data row59 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row60_col0\" class=\"data row60 col0\" >1887, LITITZ PIKE, UNIT 4, MANHEIM TOWNSHIP</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row60_col1\" class=\"data row60 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row60_col2\" class=\"data row60 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row61_col0\" class=\"data row61 col0\" >2821, E 18TH AV</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row61_col1\" class=\"data row61 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row61_col2\" class=\"data row61 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row62_col0\" class=\"data row62 col0\" >2106, MARK ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row62_col1\" class=\"data row62 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row62_col2\" class=\"data row62 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row63_col0\" class=\"data row63 col0\" >25890, 119TH STREET</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row63_col1\" class=\"data row63 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row63_col2\" class=\"data row63 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row64_col0\" class=\"data row64 col0\" >1222, VAN STEFFY AV, WYOMISSING</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row64_col1\" class=\"data row64 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row64_col2\" class=\"data row64 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row65_col0\" class=\"data row65 col0\" >16772, Heritage Ln</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row65_col1\" class=\"data row65 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row65_col2\" class=\"data row65 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row66_col0\" class=\"data row66 col0\" >450, LINCOLN AVENUE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row66_col1\" class=\"data row66 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row66_col2\" class=\"data row66 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row67_col0\" class=\"data row67 col0\" >27, GRANTHAM GLEN</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row67_col1\" class=\"data row67 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row67_col2\" class=\"data row67 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row68_col0\" class=\"data row68 col0\" >14972, GREENBRAE ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row68_col1\" class=\"data row68 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row68_col2\" class=\"data row68 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row69_col0\" class=\"data row69 col0\" >35, CR 1322</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row69_col1\" class=\"data row69 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row69_col2\" class=\"data row69 col2\" >ES</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row70_col0\" class=\"data row70 col0\" >2438, DOUBLETREE  DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row70_col1\" class=\"data row70 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row70_col2\" class=\"data row70 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row71_col0\" class=\"data row71 col0\" >6999, SHIELDS DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row71_col1\" class=\"data row71 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row71_col2\" class=\"data row71 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row72_col0\" class=\"data row72 col0\" >232, COUNTY RD 5, JACKSON</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row72_col1\" class=\"data row72 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row72_col2\" class=\"data row72 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row73_col0\" class=\"data row73 col0\" >2265, Coronado Parkway North, Unit B</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row73_col1\" class=\"data row73 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row73_col2\" class=\"data row73 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row74_col0\" class=\"data row74 col0\" >1026, E 18TH AV</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row74_col1\" class=\"data row74 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row74_col2\" class=\"data row74 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row75_col0\" class=\"data row75 col0\" >224, PINE CREST PL</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row75_col1\" class=\"data row75 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row75_col2\" class=\"data row75 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row76_col0\" class=\"data row76 col0\" >6259, ROGERS RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row76_col1\" class=\"data row76 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row76_col2\" class=\"data row76 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row77_col0\" class=\"data row77 col0\" >576, WYCHE ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row77_col1\" class=\"data row77 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row77_col2\" class=\"data row77 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row78_col0\" class=\"data row78 col0\" >1109, GLENN AVE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row78_col1\" class=\"data row78 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row78_col2\" class=\"data row78 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row79_col0\" class=\"data row79 col0\" >4821, POSTON DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row79_col1\" class=\"data row79 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row79_col2\" class=\"data row79 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row80_col0\" class=\"data row80 col0\" >1610, WALNUT AVE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row80_col1\" class=\"data row80 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row80_col2\" class=\"data row80 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row81_col0\" class=\"data row81 col0\" >4134, TN SUNP.A-3 T.JARAL SEC1 UE1, 29749</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row81_col1\" class=\"data row81 col1\" >ES</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row81_col2\" class=\"data row81 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row82_col0\" class=\"data row82 col0\" >6, HUQUENIN CT</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row82_col1\" class=\"data row82 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row82_col2\" class=\"data row82 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row83_col0\" class=\"data row83 col0\" >3761, OLD CLAYBURN RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row83_col1\" class=\"data row83 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row83_col2\" class=\"data row83 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row84_col0\" class=\"data row84 col0\" >4832-8</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row84_col1\" class=\"data row84 col1\" >JP</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row84_col2\" class=\"data row84 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row85_col0\" class=\"data row85 col0\" >1209, ALSON MILLS WAY</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row85_col1\" class=\"data row85 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row85_col2\" class=\"data row85 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row86_col0\" class=\"data row86 col0\" >262, BASSETT ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row86_col1\" class=\"data row86 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row86_col2\" class=\"data row86 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row87_col0\" class=\"data row87 col0\" >216, 3RD ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row87_col1\" class=\"data row87 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row87_col2\" class=\"data row87 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row88_col0\" class=\"data row88 col0\" >3749, CLARITY RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row88_col1\" class=\"data row88 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row88_col2\" class=\"data row88 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row89_col0\" class=\"data row89 col0\" >2619, SQUIRE PL</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row89_col1\" class=\"data row89 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row89_col2\" class=\"data row89 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row90_col0\" class=\"data row90 col0\" >1950, PITTMAN CENTER RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row90_col1\" class=\"data row90 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row90_col2\" class=\"data row90 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row91_col0\" class=\"data row91 col0\" >WILDCAT TR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row91_col1\" class=\"data row91 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row91_col2\" class=\"data row91 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row92_col0\" class=\"data row92 col0\" >28, SUNKIST VALLEY RD, Caledon</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row92_col1\" class=\"data row92 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row92_col2\" class=\"data row92 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row93_col0\" class=\"data row93 col0\" >31, 4780</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row93_col1\" class=\"data row93 col1\" >BE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row93_col2\" class=\"data row93 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row94_col0\" class=\"data row94 col0\" >Cabarrus</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row94_col1\" class=\"data row94 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row94_col2\" class=\"data row94 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row95_col0\" class=\"data row95 col0\" >494, Oxbow Creek</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row95_col1\" class=\"data row95 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row95_col2\" class=\"data row95 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row96_col0\" class=\"data row96 col0\" >0, HIGH ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row96_col1\" class=\"data row96 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row96_col2\" class=\"data row96 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row97_col0\" class=\"data row97 col0\" >121, WHITETAIL ARCHERY AVE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row97_col1\" class=\"data row97 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row97_col2\" class=\"data row97 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row98_col0\" class=\"data row98 col0\" >676, STATE ROUTE 179</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row98_col1\" class=\"data row98 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row98_col2\" class=\"data row98 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row99_col0\" class=\"data row99 col0\" >8455, BACARDI AVENUE, INVER GROVE HEIGHTS</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row99_col1\" class=\"data row99 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row99_col2\" class=\"data row99 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row100_col0\" class=\"data row100 col0\" >41, WILLIAM BLAYDES ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row100_col1\" class=\"data row100 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row100_col2\" class=\"data row100 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row101_col0\" class=\"data row101 col0\" >1539, 29 AV N</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row101_col1\" class=\"data row101 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row101_col2\" class=\"data row101 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row102_col0\" class=\"data row102 col0\" >4250, OREGON AVE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row102_col1\" class=\"data row102 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row102_col2\" class=\"data row102 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row103_col0\" class=\"data row103 col0\" >845, NORTH MARY LAKE RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row103_col1\" class=\"data row103 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row103_col2\" class=\"data row103 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row104_col0\" class=\"data row104 col0\" >3338, FALLS DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row104_col1\" class=\"data row104 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row104_col2\" class=\"data row104 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row105_col0\" class=\"data row105 col0\" >3301, CONFLANS RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row105_col1\" class=\"data row105 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row105_col2\" class=\"data row105 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row106_col0\" class=\"data row106 col0\" >3750, WEINBRENNER RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row106_col1\" class=\"data row106 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row106_col2\" class=\"data row106 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row107_col0\" class=\"data row107 col0\" >9, BROOK SIDE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row107_col1\" class=\"data row107 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row107_col2\" class=\"data row107 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row108_col0\" class=\"data row108 col0\" >312, WHEATON STREET</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row108_col1\" class=\"data row108 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row108_col2\" class=\"data row108 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row109_col0\" class=\"data row109 col0\" >RAILROAD RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row109_col1\" class=\"data row109 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row109_col2\" class=\"data row109 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row110_col0\" class=\"data row110 col0\" >1001, Steinerwaeldel, Volksberg, 67290</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row110_col1\" class=\"data row110 col1\" >FR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row110_col2\" class=\"data row110 col2\" >BE</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row111_col0\" class=\"data row111 col0\" >1919, POCO FARM RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row111_col1\" class=\"data row111 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row111_col2\" class=\"data row111 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row112_col0\" class=\"data row112 col0\" >166, OLGA DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row112_col1\" class=\"data row112 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row112_col2\" class=\"data row112 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row113_col0\" class=\"data row113 col0\" >CALEDONIA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row113_col1\" class=\"data row113 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row113_col2\" class=\"data row113 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row114_col0\" class=\"data row114 col0\" >708, FAIRMEADOW DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row114_col1\" class=\"data row114 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row114_col2\" class=\"data row114 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row115_col0\" class=\"data row115 col0\" >126, POAS CL</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row115_col1\" class=\"data row115 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row115_col2\" class=\"data row115 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row116_col0\" class=\"data row116 col0\" >1136, CLARENDON CIR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row116_col1\" class=\"data row116 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row116_col2\" class=\"data row116 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row117_col0\" class=\"data row117 col0\" >CREEK RD, DOUGLASS</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row117_col1\" class=\"data row117 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row117_col2\" class=\"data row117 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row118_col0\" class=\"data row118 col0\" >625505, 15TH SIDEROAD, TOWNSHIP OF MELANCTHON</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row118_col1\" class=\"data row118 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row118_col2\" class=\"data row118 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row119_col0\" class=\"data row119 col0\" >529, WENGLER AVE, SHARON</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row119_col1\" class=\"data row119 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row119_col2\" class=\"data row119 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row120_col0\" class=\"data row120 col0\" >40114, TN SECTOR 8, 45646</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row120_col1\" class=\"data row120 col1\" >ES</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row120_col2\" class=\"data row120 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row121_col0\" class=\"data row121 col0\" >9955, East  138Th Place</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row121_col1\" class=\"data row121 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row121_col2\" class=\"data row121 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row122_col0\" class=\"data row122 col0\" >1032, HENEY LAKE RD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row122_col1\" class=\"data row122 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row122_col2\" class=\"data row122 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row123_col0\" class=\"data row123 col0\" >1021, WOODCREEK OAKS BLVD</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row123_col1\" class=\"data row123 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row123_col2\" class=\"data row123 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row124_col0\" class=\"data row124 col0\" >514, CLEARFIELD ST</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row124_col1\" class=\"data row124 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row124_col2\" class=\"data row124 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row125_col0\" class=\"data row125 col0\" >1991, Braeburn  Circle SE</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row125_col1\" class=\"data row125 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row125_col2\" class=\"data row125 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row126_col0\" class=\"data row126 col0\" >Boiling Spring Lakes, Brunswick</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row126_col1\" class=\"data row126 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row126_col2\" class=\"data row126 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row127_col0\" class=\"data row127 col0\" >3965, SAGE DR</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row127_col1\" class=\"data row127 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row127_col2\" class=\"data row127 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row128_col0\" class=\"data row128 col0\" >3175, W 34TH AV</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row128_col1\" class=\"data row128 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row128_col2\" class=\"data row128 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row129_col0\" class=\"data row129 col0\" >83, ST ANDREWS CRESCENT</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row129_col1\" class=\"data row129 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row129_col2\" class=\"data row129 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row130_col0\" class=\"data row130 col0\" >10990, 1ST STREET, HEWITT</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row130_col1\" class=\"data row130 col1\" >US</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row130_col2\" class=\"data row130 col2\" >CA</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row131_col0\" class=\"data row131 col0\" >22, POLLETT LN, DIEPPE, NB</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row131_col1\" class=\"data row131 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row131_col2\" class=\"data row131 col2\" >US</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row132_col0\" class=\"data row132 col0\" >Kent Street, Richibucto, Kent</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row132_col1\" class=\"data row132 col1\" >CA</td>\n",
       "                        <td id=\"T_7224c262_33ad_11eb_b039_a4bb6dafa070row132_col2\" class=\"data row132 col2\" >ZA</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x20ebbe63108>"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "misclassified_records.style.set_table_styles([dict(selector='th', props=[('text-align', 'left')])])\\\n",
    "        .set_properties(**{'text-align': \"left\"}).hide_index()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Saving the trained model\n",
    "\n",
    "Once you are satisfied with the model, you can save it using the save() method. This creates an Esri Model Definition (EMD file) that can be used for inferencing on unseen data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Computing model metrics...\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "WindowsPath('models/country-classifier')"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "model.save(\"country-classifier\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Model inference\n",
    "\n",
    "The trained model can be used to classify new text documents using the predict method. This method accepts a string or a list of strings to predict the labels of these new documents/text."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "    <div>\n",
       "        <style>\n",
       "            /* Turns off some styling */\n",
       "            progress {\n",
       "                /* gets rid of default border in Firefox and Opera. */\n",
       "                border: none;\n",
       "                /* Needs to be in here for Safari polyfill so background images work as expected. */\n",
       "                background-size: auto;\n",
       "            }\n",
       "            .progress-bar-interrupted, .progress-bar-interrupted::-webkit-progress-bar {\n",
       "                background: #F44336;\n",
       "            }\n",
       "        </style>\n",
       "      <progress value='15' class='' max='15' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
       "      100.00% [15/15 00:00<00:00]\n",
       "    </div>\n",
       "    "
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<style  type=\"text/css\" >\n",
       "    #T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070 th {\n",
       "          text-align: left;\n",
       "    }#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row0_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row0_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row0_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row1_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row1_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row1_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row2_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row2_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row2_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row3_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row3_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row3_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row4_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row4_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row4_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row5_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row5_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row5_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row6_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row6_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row6_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row7_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row7_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row7_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row8_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row8_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row8_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row9_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row9_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row9_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row10_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row10_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row10_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row11_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row11_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row11_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row12_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row12_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row12_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row13_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row13_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row13_col2,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row14_col0,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row14_col1,#T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row14_col2{\n",
       "            text-align:  left;\n",
       "        }</style><table id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070\" ><thead>    <tr>        <th class=\"col_heading level0 col0\" >Address</th>        <th class=\"col_heading level0 col1\" >CountryCode</th>        <th class=\"col_heading level0 col2\" >Confidence</th>    </tr></thead><tbody>\n",
       "                <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row0_col0\" class=\"data row0 col0\" >179, RUA  JOSE BARBALHO FILHO, APARTAMENTO 103 BLOCO G, João Pessoa, PB, 58027-000</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row0_col1\" class=\"data row0 col1\" >BR</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row0_col2\" class=\"data row0 col2\" >1.000000</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row1_col0\" class=\"data row1 col0\" >2531, PARTRIDGE CRES</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row1_col1\" class=\"data row1 col1\" >CA</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row1_col2\" class=\"data row1 col2\" >0.834484</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row2_col0\" class=\"data row2 col0\" >SN, CALLE ESCUINAPA, URUAPAN, Uruapan, Michoacán de Ocampo</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row2_col1\" class=\"data row2 col1\" >MX</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row2_col2\" class=\"data row2 col2\" >1.000000</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row3_col0\" class=\"data row3 col0\" >44, WOODFORD DR, FREDERICKSBURG, Stafford County, VA, 22405</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row3_col1\" class=\"data row3 col1\" >US</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row3_col2\" class=\"data row3 col2\" >0.999997</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row4_col0\" class=\"data row4 col0\" >587, CALLE CABO SAN LUCAS, ENSENADA, Ensenada, Baja California</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row4_col1\" class=\"data row4 col1\" >MX</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row4_col2\" class=\"data row4 col2\" >1.000000</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row5_col0\" class=\"data row5 col0\" >80009, Street, Fernie, Chief Albert Luthuli</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row5_col1\" class=\"data row5 col1\" >ZA</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row5_col2\" class=\"data row5 col2\" >0.999997</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row6_col0\" class=\"data row6 col0\" >1906, Pelton Mountain  Rd, Chipman Brook, Kings County</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row6_col1\" class=\"data row6 col1\" >CA</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row6_col2\" class=\"data row6 col2\" >0.999895</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row7_col0\" class=\"data row7 col0\" >1, Chemin de Promelles, 1472</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row7_col1\" class=\"data row7 col1\" >BE</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row7_col2\" class=\"data row7 col2\" >0.999912</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row8_col0\" class=\"data row8 col0\" >1408, Cedarglen Court, Oakville, ON</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row8_col1\" class=\"data row8 col1\" >CA</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row8_col2\" class=\"data row8 col2\" >0.998583</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row9_col0\" class=\"data row9 col0\" >70, POPLAR ST N</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row9_col1\" class=\"data row9 col1\" >CA</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row9_col2\" class=\"data row9 col2\" >0.942083</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row10_col0\" class=\"data row10 col0\" >48, CL RAMON TURRO, 8389</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row10_col1\" class=\"data row10 col1\" >ES</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row10_col2\" class=\"data row10 col2\" >1.000000</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row11_col0\" class=\"data row11 col0\" >454, NORTH MANNHEIM ROAD, Hillside, 60162</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row11_col1\" class=\"data row11 col1\" >US</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row11_col2\" class=\"data row11 col2\" >0.999981</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row12_col0\" class=\"data row12 col0\" >43, Qoqonga Street, Mfuleni, City of Cape Town</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row12_col1\" class=\"data row12 col1\" >ZA</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row12_col2\" class=\"data row12 col2\" >1.000000</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row13_col0\" class=\"data row13 col0\" >1 B, TRAVESSA  GENESIO SILVEIRA, Mossoró, RN, 59600-000</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row13_col1\" class=\"data row13 col1\" >BR</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row13_col2\" class=\"data row13 col2\" >1.000000</td>\n",
       "            </tr>\n",
       "            <tr>\n",
       "                                <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row14_col0\" class=\"data row14 col0\" >GaMaphale, Greater Letaba</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row14_col1\" class=\"data row14 col1\" >ZA</td>\n",
       "                        <td id=\"T_9cae2de4_33ae_11eb_a1e5_a4bb6dafa070row14_col2\" class=\"data row14 col2\" >0.999998</td>\n",
       "            </tr>\n",
       "    </tbody></table>"
      ],
      "text/plain": [
       "<pandas.io.formats.style.Styler at 0x20ebbe53848>"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "text_list = data._train_df.sample(15).Address.values\n",
    "result = model.predict(text_list)\n",
    "\n",
    "df = pd.DataFrame(result, columns=[\"Address\", \"CountryCode\", \"Confidence\"])\n",
    "\n",
    "df.style.set_table_styles([dict(selector='th', props=[('text-align', 'left')])])\\\n",
    "        .set_properties(**{'text-align': \"left\"}).hide_index()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Conclusion"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this notebook, we have built a text classifier using `TextClassifier` class of `arcgis.learn.text` module. The dataset consisted of house addresses of 10 countries written in languages like English, Japanese, French, Spanish, etc. To achieve this we used a [multi-lingual transformer backbone](https://huggingface.co/transformers/v3.0.2/multilingual.html) like `XLM-RoBERTa` to build a classifier to predict the country for an input house address. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# References"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[1] [Learning Rate](https://en.wikipedia.org/wiki/Learning_rate)\n",
    "\n",
    "[2] [Accuracy](https://en.wikipedia.org/wiki/Accuracy_and_precision)\n",
    "\n",
    "[3] [Precision, recall and F1-measures](https://scikit-learn.org/stable/modules/model_evaluation.html#precision-recall-and-f-measures)"
   ]
  }
 ],
 "metadata": {
  "esriNotebookRuntime": {
   "notebookRuntimeName": "ArcGIS Notebook Python 3 Advanced with GPU support",
   "notebookRuntimeVersion": ""
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.2"
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {},
   "toc_section_display": true,
   "toc_window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}
